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REMARKS/ARGUMENTS 

These mmarks are made in response to the Office Action of September 17, 2004 

(Office Action), in which claims 1-43 and 46-49 under 35 U.S.C. § 102(b) were rejected 
as being anticipated by U.S. Patent No. 5,719,997 to Brown, et al. (Brown). 

Applicant has amended the title to conform to the Examiner's remarks. Applicant 
has also renumbered each of the claims following Claim 43 to correct the claim 
numbering to also conform to the Examiner's remarks. Applicant has amended 
independent Claims 43 and renumbered Claim 48 to further clarify certain features of 
Applicant's invention. The amendments are fully supported in Applicant's Specification 
at, for exampb, pages 15-17 and 23. No new matter has been added by virtue of these 
amendments. As this response is timely filed within the three-month statutory period, no 
fee is believed due. 



I. A pplicinPs Invention 

Before addressing the art cited by the Examiner, it may be helpful to briefly 

review certair, features of Applicant's invention. The Applicant's invention concerns a 

method and a system for including grammars in a statistical parser for use with a natural 

language understanding (NLU) system. The method, for example, includes receiving a 

text input and applying a first context-free grammar (CFG) to the text input so as to 

determine substrings and corresponding parse trees. The substrings and corresponding 

parse trees can correspond to the first CFG. Each substring can be examined using an 
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inventory of queries corresponding to the first CFG. Alternately, each substring can be 
examined using one or more features each having a corresponding weight which is 
determined du ring training of the NLU system. 

Accordng to Applicant's invention, queries can be used, for example, to make 
determinations such as the following regarding any possible substring and parse tree 
associated wit!) a portion of te*t; 

• Is a word of text contained within a nonterminal of a particular CFG? 

• Does the word begin a substring in the set of parses found by the CFG? 

(See, Applicant's specification, pp. 15-16.) A response to one query can render othere 
moot, while alternately rendering others more pertinent, Queries and/or features, 
moreover, car be directed at CFG terminals within non-terminals so as to determine 
whether any of the following situations obtain with respect to a portion of text: 

• Does a word begin a substring that can be parsed by the grammar? 

• Does the word continue a substring that can be parsed by the grammar and 
cominue an open constituent already started? 

• Docs the word continue a substring that can be parsed by the grammar and 
close an open constituent already started? 

• Doc s a current constituent just created continue a current open one? 
(See Applicant's Specification, p.23.) 
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One adv antage of using such queries or features as taught by Applicant's invention 
is that their use provides a mechanism for guiding or enhancing in an NLU system a 
statistical parasr based either on decisions trees or the maximum entropy principle. This 
allows for smaller, more specific grammars for particular constituents or word groupings, 
which, in turn, can reduce the amount of training data and time needed to train an NLU 
system. (See., e.g., Applicant's Specification, pp. 16-17.) The use of queries and/or 
features as taught by Applicant's invention can be used to train the statistical system 
during a trainhg phase before it is instantiated for real-time parsing of phrases identified 
by the CFG. (Applicant's Specification, p. 16.) 

II. U-S. Pa tent 5.7 19.997 Brown 

Brown not teach or inherently possess every feature of Applicant's for invention. 

Indeed, Brown is not even concerned with the problems addressed by Applicant's 
invention. Brown, for example, is not directed to the training of an NLU. Brown is 
explicitly directed to recognising "connected input by instantiating a grammar in real 
time." (Col. 3, lines 23-25.) In particular. Brown is concerned with real-time 
instantiation and de-instantiation of "ephemeral models" such as an "ephemeral" Hidden 
Markov Models (EHMM). The real-time instantiation is intended to reduce hardware- 
based memoiy requirements by "selectively creating and destroying portions of [a] 
grammar instantiation." (Col. 2, lines 34-48; Col. 3, lines 23-34.) Real-time creations 
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and destructions of a grammar do not relate to the training, guiding or enhancing of a 
statistical parse r in an NLU system as taught by Applicant's invention. 

Not surprisingly, Brown does not disclose or even suggest either the use of an 
inventory of queries or the use of features corresponding to a CFG, as taught by 
Applicants' invention. The Examiner points to Brown's reference to "[a] table of 
grammar node scores" that is "updated at each frame [of speech]," but this is not at all 
similar to the emeries or features corresponding to a CFG as in Applicant's invention. 

The socres in Brown do not correspond to a CFG or otiier grammar, but rather to 
the segments of speech that are cumulatively scored at discrete points during a speech 
processing event. (Col. 5, lines 15-23, 55-65; FIG 2 and FIG. 3.) To understand the node 
soores of Brown, it is necessary to understand how they are constructed and applied. 
Brown processes speech input by creating "phrase paths" comprising a serial 
concatenation of arcs" in accordance with a grammar. (Col. 4, line 64 - Col. 5, line 6.) 
An output hyjKrthesis score is generated for the arcs at each node to which one or more 
arcs is connected. (Col. 5, lines 15-55; FIG. 2). Segments of the speech input are 
sequentially examined and, at each successive node, the scores are cumulated with 
previously examined ones. This process culminates in a score each alternative phrase 
path corresponding to a speecli input. (Col. 6, lines 50-55; FIG. 3.) The table of scores is 
generated by selecting the largest hypothesis score for each node. (Col. 6, lines 53-55.) 

20 

<WP2 11034:1) 

PAGE 22/25 ' RCVD AT 12/17/2004 5:1 6:37 PM [Eastern Standard Time] * SVR:USPT0-EFXRF-1/7 ' DNIS:8729306 * CSID:5616596313* DURATION (mm-$s):0W)4 



5616596313 T-940 P. 22/25 Job-325 

IBM Docket No. BOC9-2000-0021 



• .OEC-ir-04 17:22 From:AKERMAN,SENTERFITT i EIDSON 5616596313 T-940 P. 23/25 Job-325 

Appln. No. 09/e 96,764 IBM Docket No. BOC9-2000-0021 

Amendment daled Dec. 17, 2004 
Reply to Office Action of Sep. 17, 2004 
Docket No. 6169-165 

It is important to note that, in connection with the table of node scores, Brown 
does not disclose or suggest the use of features or an inventory of queries as taught by 
Applicant's invention. More fundamentally, the scores themselves do not correspond to a 
CFG, or other grammar; they correspond to arcs along a phrase path. The critical 
difference between Brown's scores and both the features and inventory of queries of 
Applicant's in vention is apparent from the different functions performed by the features 
and inventory of queries corresponding to a CFG. 

For example, the scores provide no mechanism for guiding or enhancing a 
statistical parser based either on decision trees or the maximum entropy principle. Nor 
do the scores provide for smaller, more specific grammars for particular constituents or 
word groupings. Accordingly, the scores in Brown also can not be used to reduce the 
amount of training data and time needed to train an NLU system, as discussed at pages 
16-17 of the Applicant's Speci fication, for example. Moreover, the scores can not train a 
statistical system during a training phase: the scores aTe expressly applied during a real 
time speech processing event. 

CONCLUSION 

Applicant respectfully maintains that Brown fails to disclose every feature of 
Applicant's invention. For example, as detailed above, Brown fails to teach or suggest a 
system or method that includes the application of features or an inventory of queries 
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corresponding to a CFG, as taught by Applicant's invention and recited in each of 
independent Cairns 1, 16, 20, 24, and 39, as well re amended independent Claims 43 and 
48. 

Additionally, Applicant respectfully emphasizes that in addition to not teaching or 
inherently possessing each aspect of the claimed invention, Brown fails to contemplate 
the claimed invention, as can be easily discerned from the above remarks. For example, 
Brown does not solve the same problems that Applicant's invention does, nor would the 
Applicants' claimed invention be obvious to one of ordinary skill in the art in light of 
Brown or other known techniques and methodologies that existed at the time of 
Applicant's invention. There would be no reason, other than the Applicant's disclosure, 
for one of ordinary skill in the art to derive teachings similar to the Applicant's claimed 

invention based upon Brown. 

Accordingly, the prior art fails to provide a basis for rejecting each of independent 
Claims 1, 16, 20, 24, and 39 as well as amended independent Claims 43 and 48. The 
prior art also fails to provide a basis for rejecting the dependent claims since each recites 
yet additional features over those set forth in the independent claims from which each 
depends. Applicants, therefore, respectfully request that the Examiner's rejections be 
withdrawn. 

Applicants believe that this application is now in full condition for allowance, 
which action is respectfully requested. Applicants request that the Examiner call the 
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undersigned if clarification is needed on any matter within this Amendment, or if the 
Examiner beliuves a telephone interview would expedite the prosecution of the subject 
application to completion. 



Respectfully submitted, 

Gregory A. Nelson, Registration No. 30,577 
Richard A. Hinaon, Registration No. 47,652 
Brian Buchheit, Registration No. 52,667 
AKERMAN SENTERFITT 
Customer No. 40987 
Post Office Box 3188 
West Palm Beach. FL 33402-3188 
Telephone: (561) 653-5000 
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